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CONTROL OBJECT AND USER INTERFACE FOR CONTROLLING 

NETWORKED DEVICES 

FIELD OF THE INVENTION 

5 

The present invention relates generally to facility management systems such as home 
automation systems, and, more particularly, to an object oriented design software control 
object within such systems that provides for a logical representation and implementation of a 
network of physical devices. 

10 BACKGROUND OF THE INVENTION 

In the past, environments having networked equipment were typically limited to 
commercial and industrial sites. Such equipment was typically complex and highly 
sophisticated computer controlled machines that utilized networks to coordinate 

1 5 manufacturing activities. However, unlike the commercial and industrial setting, the typical 
consumer setting included devices and appliances that were fairly unsophisticated and that 
were operated by a user on a one-to-one basis. To achieve the consumer device's specific 
function, the user had to physically interact with the device by, for example, pressing buttons 
on a coffee maker to preset the machine to turn ON at a specific time. 

20 Early advances in consumer devices and appliances were limited to remote control 

devices that, at first, were wired to the device, and later used infrared (ER) communications to 
transmit commands. However, the remote control devices still forced the user to interact with 
their respective devices on a one-to-one basis. In addition, most hand-held remote control 
devices were proprietary, which required separate remote controllers for each consumer 

25 product. Further advancements included universal remote controllers that were capable of 
being programmed to control many consumer devices. However, universal remote control 
devices were limited in that they were typically not able to control devices other than 
entertainment equipment. 
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Lately, consumer appliances have become more sophisticated because of the decreased 
size and costs of computer-related components such as microprocessors. These new 
consumer devices include the so-called "smart" devices that, like the sophisticated 
commercial and industrial machinery, are capable of executing predefined tasks and capable 
5 of communicating over a network infrastructures. An example of a system is smart devices is 
CEBus®, which may utilize household powerlines to transport messages between compliant 
CEBus® household devices. CEBus® is implemented per EIA IS-60 for home automation. 
The CEBus® system utilizes controller and receptacle units to communicate and control 
CEBus® compliant devices. The receptacle units are connected to standard household 
O 10 receptacles and the command and control information is communicated over the powerlines. 

However, the CEBus® system is a hardware solution, which requires that the compliant 
devices be designed to be compatible with the standard. As a further limitation, the CEBus® 
controller is a special-purpose device. While this is an advancement over prior solutions, this 
hardware solution limits the upgradablity of the network and the devices, and fails to provide 
15 a solution for non-compliant smart devices. 

A further example of a system that is intended to network devices is Jini™, which is 
based on Java™. Jini™ uses Java Remote Method Invocation protocols to move code around 
a network of devices. Network services run on top of the Jini™ software architecture such 
that devices and applications may register with the network via a lookup service. However, 
20 the Jini™ system is limited in that each device must register with the lookup service for other 
devices to discover them. Thus, each device is not aware of other devices on the network 
without first pointing to the lookup service. Further, there is no general purpose user interface 
tliat enables a user to interact and control all of the networked devices from a remote location. 
In view of the above, there is a need for a system whereby once isolated and non- 
25 remotely controllable and configurable devices are able to share information with and about 
each other, and are able to provide and accept common command, control, and 
communication though a network. There is also a need for a system that provides the 
networked devices with the ability to operate autonomously in the case of a network failure, 
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or for localized control and operation. There is also a need for a system that provides users 
with a method to control devices with a general purpose device (e.g., personal computer), and 
that provides a method to communicate over open network infrastructures. The present 
invention provides a solution to address the limitations and shortcomings of the prior art. 

5 SUMMARY OF THE INVENTION 

The present invention includes a set of software components and an application 
programming interface for the logical networked representation and implementation of a 
system of smart devices. The software components may be generally expressed as a control 
£3 10 object component and a user interface component. The control object (CO) is a software 
object that may carry out communication, and accept and issue control messages. The control 
object allows a user to remotely control or query a physical device for which the specific 
control object has responsibility and also maintains logical and physical connections and 
control of the device. 

15 The second component is the user interface, or consumer presentation display (CPD), 

which supplies a coherent and transparent interface across all network media and topologies. 
The user interface is capable of communicating with any control object that it identifies as 
being controllable in a given system. This communication may be across a logical network or 
may be local to a particular device. The user interface takes on the "personality" of the 
20 physical device for which the attendant control object carries a logical and physical mapping 
and control responsibility. 

In accordance with an aspect of the invention, the control object may be adapted to 
bind to any designed physical transport mechanism for communication with other control 
objects and is adapted to be embedded in a container application and executed within a 
25 wrapper executable. In addition, the control object is preferably polymorphic, and thus is able 
to take on the logical attributes and command and control capabilities of any of the devices. 

The control object may be a component object model object (COM) that exists within 
the operating system. This preferably provides wrappers for exposed clients and enables the 
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use of method calls and exposed properties by the operating system or other application 
software programs. The control object may include extensions such that the control object 
may logically and physically pass a control signal to the devices and send a message to one of 
any electronic controllers or interfaces provided in the devices. 
5 In accordance with a feature of the invention, the first registered control object in the system 
may be designated a manager object, which performs list management to maintain and 
administer the list of control objects by periodically broadcasting the list to all registered 
control objects on the system. The list contains the logical attributes, an identifier and an 
address of all registered control objects on the system. The Identifiers are preferably globally 
10 unique random numbers generated at runtime, so as to identify each registered object "on-the- 
fly." This globally unique identifier may be also used with directed object-to-object 
communication, where a specific object must communicate with another specific object. 
Preferably, the random generator is a linear congruential generator; i.e., f(z) = 16807 z mod 
(2**31-1). 

15 In accordance with another feature of the present invention, the user interface is 

adapted to control the devices either locally or across the network. The user interface may 
also be adapted to control all of the devices that are functioning on the network via the control 
object. In addition, the user interface preferably supplies a coherent and transparent interface 
across all network media and topologies. Further, if the devices include a display by which 

20 the device may be controlled, in accordance with an aspect of the invention, the display may 
be adapted to control other devices via the network and the control objects. 

In accordance with an aspect of the present invention, a method of registering the 
control objects is provided, which includes broadcasting a control message from an enabled 
control object to inform other registered control objects that the enabled control object exists; 

25 determining if the enabled control object is a first registered control object; and appointing the 
first registered object as a manager object to administer the list. 

The manager object may send the list to any new control object that registers with the 
system; periodically broadcast the list to all registered control objects; and perform a 
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synchronization to force all other control objects to synchronize to the list. An election 
process is held if the manager object ceases to function. The election process may comprise 
promoting a second registered control object to the manager object; promoting all other 
control objects up one position on the list; and distributing the list to all registered control 
objects on the system. If any other control object ceases to function, the list is preferably 
distributed to all registered control objects if any control object other than the manager object 
ceases to function. 

Other features of the invention are described below. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing summary, as well as the following detailed description of the preferred 
embodiments, is better understood when read in conjunction with the appended drawings. For 
the purpose of illustrating the invention, there is shown in the drawings an embodiment that is 
presently preferred, in which like references numerals represent similar parts throughout the 
several views of the drawings, it being understood, however, that the invention is not limited 
to the specific methods and instrumentalities disclosed. In the drawings: 

Figure 1 is a block diagram representing a computer system in which aspects of the 
present invention may be incorporated; 

Figure 2 is an exemplary environment in which aspects of the present invention may 
be incorporated; 

Figure 3 is a block diagram illustrating the internal architecture of a control object of 
the present invention; 

Figure 4 is a block diagram illustrating the interaction of the control object with 
external software components, an operating system and physical transport media; 

Figure 5 is block diagram illustrating the relationship of list and object management, 
application programming interfaces, transport dynamically linked libraries, physical media 
routines, and the physical media; 
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Figure 6 is a flowchart illustrating the process by which the control object registers 
with the system and how a manager object is appointed; 

Figure 7 illustrates an election process whereby a new manager object is appointed 
when an existing manager is removed from the system; 
5 Figure 8 illustrates an election process whereby a new manager object is appointed 

when a periodic message is not received from the manager object; and 

Figures 9 A, 9B, 10A, 10B, 11 and 12 are exemplary Booch diagrams that express the 
static structure of the object classes, their internal structure, and the relationships in which 
they participate in a preferred embodiment of the system described above with regard to 
10 Figures 2-7. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention provides for a software system that may be implemented on any 
network infrastructure such that networked devices may be remotely controlled by, e.g., a 
15 general purpose computer, and a system whereby the networked devices may share 
information with and about each other. The present invention provides and accepts common 
command, control and communication through the network while retaining the ability of each 
device to operate autonomously. 

Computer Environment 

20 Figure 1 and the following discussion are intended to provide a brief general 

description of a suitable computing environment in which the invention may be implemented. 
Although not required, the invention will be described in the general context of 
computer-executable instructions, such as program modules, being executed by a computer, 
such as a client workstation or a server. A more detailed description of the invention will be 

25 presented with reference to the home area network of Figure 2 and the description of the 
control object in Figures 3-12. 

Generally, program modules include routines, programs, objects, components, data 
structures and the like that perform particular tasks or implement particular abstract data 



MSFT-0021 
117834.1 



types. Moreover, those skilled in the art will appreciate that the invention may be practiced 
with other computer system configurations, including hand-held devices, multi-processor 
systems, microprocessor-based or programmable consumer electronics, network PGs, 
minicomputers, mainframe computers and the like. The invention may also be practiced in 
5 distributed computing environments where tasks are performed by remote processing devices 
that are linked through a communications network. In a distributed computing environment, 
program modules may be located in both local and remote memory storage devices. 

As shown in Figure 1, an exemplary system for implementing the invention includes a 
general purpose computing device in the form of a conventional personal computer 20 or the 
10 like, including a processing unit 21, a system memory 22, and a system bus 23 that couples 
various system components including the system memory to the processing unit 21. The 
system bus 23 may be any of several types of bus structures including a memory bus or 
P memory controller, a peripheral bus, and a local bus using any of a variety of bus 

I 3 architectures. The system memory includes read-only memory (ROM) 24 and random access 

^ 15 memory (RAM) 25. A basic input/output system 26 (BIOS), containing the basic routines that 
P help to transfer information between elements within the personal computer 20, such as 

l during start-up, is stored in ROM 24. The personal computer 20 may further include a hard 

%i ( disk drive 27 for reading from and writing to a hard disk, not shown, a magnetic disk drive 28 

for reading from or writing to a removable magnetic disk 29, and an optical disk drive 30 for 
20 reading from or writing to a removable optical disk 31 such as a CD-ROM or other optical 
media. The hard disk drive 27, magnetic disk drive 28, and optical disk drive 30 are connected 
to the system bus 23 by a hard disk drive interface 32, a magnetic disk drive interface 33, and 
an optical drive interface 34, respectively. The drives and their associated computer-readable 
media provide non-volatile storage of computer readable instructions, data structures, program 
25 modules and other data for the personal computer 20. Although the exemplary environment 
described herein employs a hard disk, a removable magnetic disk 29 and a removable optical 
disk 31, it should be appreciated by those skilled in the art that other types of computer 
readable media which can store data that is accessible by a computer, such as magnetic 
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cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access 
memories (RAMs), read-only memories (ROMs) and the like may also be used in the 
exemplary operating environment. 

A number of program modules may be stored on the hard disk, magnetic disk 29, 
5 optical disk 31, ROM 24 or RAM 25, including an operating system 35, one or more 
application programs 36, other program modules 37 and program data 38. A user may enter 
commands and information into the personal computer 20 through input devices such as a 
keyboard 40 and pointing device 42. Other input devices (not shown) may include a 
microphone, joystick, game pad, satellite disk, scanner or the like. These and other input 

10 devices are often connected to the processing unit 21 through a serial port interface 46 that is 
coupled to the system bus, but may be connected by other interfaces, such as a parallel port, 
game port or universal serial bus (USB). A monitor 47 or other type of display device is also 
connected to the system bus 23 via an interface^ such as a video adapter 48. In addition to the 
monitor 47, personal computers typically include other peripheral output devices (not shown), 

15 such as speakers and printers. 

The personal computer 20 may operate in a networked environment using logical 
connections to one or more remote computers, such as a remote computer 49. The remote 
computer 49 may be another personal computer, a server, a router, a network PC, a peer 
device or other common network node, and typically includes many or all of the elements 

20 described above relative to the personal computer 20, although only a memory storage device 
50 has been illustrated in Figure 1. The logical connections depicted in Figure 1 include a 
local area network (LAN) 51 and a wide area network (WAN) 52. Such networking 
environments are commonplace in offices, enterprise-wide computer networks, Intranets and 
the Internet. 

25 When used in a LAN networking environment, the personal computer 20 is connected 

to the local network 51 through a network interface or adapter 53. When used in a WAN 
networking environment, the personal computer 20 typically includes a modem 54 or other 
means for establishing communications over the wide area network 52, such as the Internet. 
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The modem 54, which may be internal or external, is connected to the system bus 23 via the 
serial port interface 46. In a networked environment, program modules depicted relative to the 
personal computer 20, or portions thereof, may be stored in the remote memory storage 
device. It will be appreciated that the network connections shown are exemplary and other 
5 means of establishing a communications link between the computers may be used. 

Home Area Network Environment Employing a Control Object and User Interface 
As noted, the computer 20 described above can be deployed as part of a computer 
network within which the system of the present invention may be implemented. In general, 
the above description applies to both server computers and client computers deployed in a 

10 network environment. As will become evident, the above description may also apply, in part, 
to appliances and devices attached to the network that have the ability to accept and execute 
software instructions. Figure 2 illustrates one such exemplary network environment in which 
the present invention may be employed. 

The present invention may be implemented in, for example, a household, a small 

15 office, or other similar environment. As illustrated, several devices are attached to the 
network 10 that may be controlled by users within the home or office. Such devices include, 
for example, a game device 112, a video device (VCR) 114, a telephone 116, a smart AC 
outlet 118, an answering machine 120, and a television 122, which may be connected to the 
network 10 as client devices. Other consumer devices, small office machines, and security 

20 devices may be connected to the network 10. 

Also connected to the network are general purpose computing devices that may 
control the above-identified devices 112-122. Such devices include a notebook (laptop) 
computer 49, a hand-held computing device 63, and a desktop PC/server 20. The notebook 
computer 49 preferably operates utilizing Windows® 95/98 or Windows NT® 4.0 

25 Workstation (or higher) operating systems. The hand-help computing device 63 preferably 
operates running Windows® CE 2.0 (or higher) operating system. The PC/Server 20 
preferably runs the Windows NT® 4.0 Workstation or Server (or higher) operating system. 
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As illustrated, the devices 20, 49, 63 and 112-122 are connected to a network medium 
136. The physical transport of the medium 136 is preferably Ethernet, since this topology is 
in ubiquitous use. However, the present invention is not limited to any particular physical 
network technology and may include fiber optic, X.10, and serial. This system 10 preferably 
5 utilizes TCP and Internet protocol (IP) as a common network layer, although it is not limited 
to the TCP/IP transport protocol, and the devices 20, 49, 63 and 112-122 are preferably 
identified by EP addresses. 

In accordance with the present invention, each of the above consumer devices 1 12-122 
is represented by a control object C01-C06. As will be described in greater detail below, the 

10 control objects C01-C06 are software objects designed to logically take on the physical 
attributes of devices 1 12-122 attached to the network 10. 

Although not shown in Figure 2, the devices 112-122 preferably include a 
microprocessor/microcontroller and a read-only memory containing an embedded operating 
system (e.g., Windows® CE 2.0 (or higher)). The embedded operating system and/or an 

15 application running on the operating system serves to control the functions of the devices 112- 
122. The methods provided by the control objects CO (discussed below) may be executed by 
the operating system or the software application. It is preferable that the operating system of 
the devices include application programming interfaces (APIs) to enable each device's 
attendant control object CO to control the device based on the information contained within 

20 the control object CO. Such a structure would allows device manufacturers to use the control 
object CO, application software, and/or the device operating system to implement functions 
that would be appropriate for the manufacturer's specific device or service (e.g., providing 
play and record functions within the VCR 114). 

The present invention also provides for a user interface to allow users to interact and 

25 control the devices 112-122. The general purpose computing devices 20, 49 and 63 may act 
as the user interface or "consumer presentation displays" (CPD) 130, 132 and 134 to provide a 
coherent and transparent interface to users across all network media 136 and topologies. The 
user interface will be described in greater detail below. 
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Control Object Architecture and User Interface 
Control Object 

The control object and its operation within the network 10 will now be described in 
greater detail with reference to Figures 3-11. The control object CO logically represents the 
5 attributes of its associated physical device in order to provide for local and/or remote control 
of the device. The control object CO additionally maintains a list of other control objects CO 
registered on a given system such that any one control object may logically control any 
physical device connected to the system network. An exemplary implementation of the 
control object CO will now be described. 

10 The control object CO supports a layered software model that allows multiple 

transport layers to bind to the core object . at runtime. The control object CO is preferably 
polymorphic, meaning that it can take on the logical attributes and command and control 
capabilities of any particular real- world device. The control object CO also is adapted to bind 
to any designed physical transport mechanism for communication with other control objects 

15 or control programs. The control object is further preferably capable of being embedded in a 
container application and/or executed within a wrapper executable. When the control objects 
C01-C06 are active, each carries out communication, accepts and issues control messages, 
contains data specific to the devices on the network, and allows a user to remotely control or 
query the physical device for which the specific control object CO has responsibility for 

20 maintaining logical connections and control. 

Figures 3 and 4 illustrate the inner architecture of the control object CO and the 
connectivity of the control object to a user interface 156, an operating system kernel 154, 
physical transport dynamically linked libraries (DLLs) 152, and the physical medium 36. As 
a summary, the control object CO is preferably embodied as a Component Object Model 

25 (COM) object that exists within the operating system (e.g., Windows® 95/98, Windows NT®, 
Windows® CE) that calls transport DLLs 152 through well known medium neutral 
application programming interfaces (APIs) 170 to communicate via the network medium 36. 
The data and events to be communicated by the control object CO, are embodied as callbacks 
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and function (method) returns. Typically, the control object CO will load, activate, 
deactivate, and pass data to and from the transport. 

Turning to the exemplary embodiment, the control object CO includes a core 150 that 
has a COM interface to access the operating system kernel and COM services 154. The 
5 operating system kernel schedules activities (threads) for the computer processor to perform, 
and it handles interrupts and exceptions. If the computer has multiple processors, the kernel 
synchronizes activity among the processors to optimize performance. COM provides a binary 
standard for component interoperability by allowing any programming language that can call 
functions via pointers (e.g., C, C++, Small Talk®, Ada, and Basic) to interoperate with other 

10 components written to the same binary standard. The control object CO preferably utilizes 
COM services 154 and the associated interfaces, because the interfaces have predefined 
behaviors and responsibilities that allow applications to interact with each other and the 
operating system, are programming language-independent, and are provided on multiple 
platforms (e.g., Microsoft® Windows®, Microsoft® Windows NT®, Apple® Macintosh®, 

15 UNIX®). 

APIs 170 are called to translate to and from the transport DLLs 152 that provide for 
physical transport of information over the network medium 36. The APIs are a set of routines 
that request and carry out lower-level services performed by the operating system. In the case 
of Microsoft® Windows® operating systems, the APIs may also manage the application's 

20 windows, icons, menus, and dialog boxes. 

The transport DLLs 152 are reusable functions that can be called from other 
executable code. Under the Win32® model used in Microsoft® Windows® 95/98 and 
Windows NT®, the operating system maps the DLLs into the address space of a process when 
the process is starting up or while it is running. The process then executes the functions of the 

25 DLL. 

The control object core 150 also communicates to the user interface 156, which 
operates as the aforementioned consumer presentation display (CPD). The user interface 156 
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communicates with registered control objects COs for each of the physical devices 112-122 
connected to the media 36. A more detailed description of the CPD is provided below. 

The control object CO provides wrappers (container) 163 for exposed clients and 
enables use of method calls and exposed properties 166 that may be used by e.g., an operating 
5 system or other application software program. The wrapper 163 is provided to envelope (i.e., 
wrap) a call to a function or program inside another function or program. Methods and 
exposed properties 166 are logical operations provided by an object. In object-oriented 
programming, an object invokes a method by sending a message that contains the receiving 
object and the name of the specific method to invoke. Objects use messages as the 

10 mechanism through which they interact. Preferably, the methods are data neutral, in that they 
all take arguments of type VARIANT. Such typing allows the methods to be interoperable 
with Visual Basic, Delphi, and other ActiveX objects, as well as with C/C++, and applications 
such as Microsoft Internet Explorer (via HTML based scripting). An exemplary list of 
methods and exposed properties 166 available to the client container 164 are outlined in Table 

15 1 A below. 

TABLE 1A 
Methods Exposed to the Client Container 

STDMETHOD(GetAvailableData)(VARIANT *iPos, VARIANT *iLen, VARIANT *Data); 



20 



25 



30 



This method allows a client to receive data after a "data available" event has 
been fired. 

STDMETHOD(Get06LastNode)(VARIANT *i); 

This method retrieves the position of the last CO in the global list (for 
enumeration). 

STDMETHOD(06Load)(short *i, BSTR bAnnounce, BSTR IP, short *Port); 

This method loads the object (and its transport DLL) and initializes input 
parameters. 
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STDMETH0D(Get06Member)(VARIANT *i, VARIANT *HOType, VARIANT * 
pAnnounce, VARIANT * bIP, VARIANT * iPort, VARIANT *iRand); 

This method allows a client to receive list information on any registered CO 
5 present on the network. 

STDMETHOD(get_MyPositionInQueue)(/*[out, retval]*/ VARIANT *pVal); 

This method (property) allows the client to discover its position on the global 
10 list. 

STDMETHOD(get_bstrIP)(/*[out, retval]*/ VARIANT *pVal); 

This method (property) allows a client to receive its CO's IP or GUID. 

15 

STDMETHOD(get_ControlEnumType)(/*[out, retval]*/ VARIANT *pVal); 

This method (property) allows a client to discover it's own enumerated type. 
20 STDMETHOD(put_ControlEnumType)(/*[in]*/ short newVal); 

This method (property) allows a client to set its enumerated type. 
STDMETHOD(Deactivate)(); 

25 

This method allows a client to deactivate (deregister) the associated CO. 
STDMETHOD(Activate)(); 
30 This method allows a client to activate (register) the associated CO. 

STDMETHOD(SendData)(short *Pos, BSTR *Data); 

This method allows a client to send arbitrary data to another CO (client). 

35 

In general, when a COM object notifies its clients that something has happened, the 
COM object sends out a message. The message is called an event and the process of sending 
the message is referred to as "event firing." In accordance with the present invention, Table 
IB outlines an exemplary list of methods (i.e., logical operations) that cause event firings on 
40 behalf of the client container 164. 
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TABLE IB 
Methods that Cause Event Firings 

STDMETHOD(Event_Activate)(); 

5 

The control object CO is activated. 
STDMETHOD(Event_Loaded)(); 
10 The control object CO is loaded and initialized. 

STDMETHOD (Event_DeActivate)(); 

The control object CO is deactivated and deregistered. 

15 

STDMETHOD (Event_DataAvail)(); 

There is incoming data available. 

20 The interaction between the control object CO and the transport DLLs 152 is 

illustrated in greater detail with reference to Figure 4 and Tables 2A and 2B below. As shown 
in Figure 4, Input and Output APIs 170a and 170b call transport DLLs that provide for core 
input and output management and the transport routines 152a and 152b. The APIs 170 and 
transport DLLs 152 are preferably provided by the operating system for the purpose of 

25 transporting data. The transport routines 152a and 152b, together with physical media 
routines 152c, provide access to the physical media 36 by providing the necessary transport 
protocol of the media (e.g., IP, serial, etc.). As noted above, the data and events that need to 
be communicated by the control object CO are embodied as callbacks and function (method) 
returns and the control object CO will typically need to load, activate, deactivate, and pass 

30 data to and from the transport. 

TABLE 2A 
Calls into the Transport DLL 

TYPEDEFS: 
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typedef VOID * (WINAPIV* LPFNDLLFUNC1)(V0ID *, VOID *); 

typedef VOID * (WINAPIV* LPFNDLLFUNC2)(VOID *,int *, int *,LPSTR,LPSTR,int *, 
int *); 

5 

typedef INT (WINAPIV* LPFNDLLFUNC3)(VOID *); 

typedef VOID (WINAPIV* LPFNDLLFUNC4)(VOID *,int); 

10 typedef VOID (WINAPIV* LPFNDLLFUNC5)(VOID *,LPSTR); 

typedef VOID * (WINAPIV* LPFNDLLFUNC6)(VOID *,int *,int *, LPSTR); 

typedef VOID * (WINAPIV* LPFNDLLFUNC7)(VOID *, VOID *, int i, LPSTR 
15 b Announce, LPSTR IP, int Port); 

typedef VOID * (WINAPIV* LPFNDLLFUNC8)(VOID *, int * i, int *j, LPSTR Data); 

20 TABLE 2B 

Transport Call Definitions 

extern "C" _declspec(dllexport) void * CPPLoad(void * uPtr, void * uPtrA, int i, LPSTR 
pAnnounce, LPSTR pIP, int Port) 

25 

Loads the Physically neutral part of the transport DLL routines, including 
linked list and object instantiation. Fires a "loaded" event when done. 

extern "C" declspec(dllexport) void * CPPActivate(void * uPtr, void * uPtrA) 

30 

Activates the physical transport. Fires an "activated" event when done. 

extern "C" declspec(dllexport) void * CPPDeactivate (void * uPtr, void * uPtrA) 

35 Unloads the physical transport, deregisters the object, and returns the object to 

a neutral state. ' 



40 



extern "C" _declspec(dllexport) void * CPPSendData (void *uPtr, int *i, int *iLen, LPSTR 
bPtrA) 

Sends actual data to the transport DLL for relay to another CO on the network. 
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extern M C" _declspec(dllexport) void * Get06Member (void *uPtr, int *i, int *j, LPSTR 
bPtrA, LPSTR 

5 Receives CO network member data based upon the member's position in the 

global list. 

extern "C" declspec(dllexport) int GetControlEnumType (void *uPtr) 

10 Returns the enumerated CO type (i.e. VCR, LIGHT, STEREO, etc.) 

extern "C" declspec(dllexport) void PutControlEnumType (void *uPtr, int i) 

Registers the enumerated CO type (i.e. VCR, LIGHT, STEREO, etc.) 

15 

extern "C" _declspec(dllexport) void GetIP (void *uPtr, LPSTR bPtrA) 

Returns the IP address of the local object. If not IP based, this API returns a 
GUID that is generated for the instantiation of the local object. 

20 

extern "C" declspec(dllexport) int GetPosition (void *uPtr) 

Returns the local object's position in the global list. 
25 extern "C" _declspec(dllexport) int Get06LastNode (void *uPtr) 

Returns the maxima of the global list, 
extern "C" _declspec(dllexport) void GetData (void *uPtr, int *iPos, int * iL, LPSTR uData) 

30 

Returns data that has been received from another CO, and a data-available 
event has been fired for. 

extern "C" void _cdecl SendDataToClient(int i, int j, void * buff) 

35 

Callback for certain instances (architecturally) of the CO. It takes the place of a 
manual GET on the inbound data received from another CO. 



40 



In addition to the control object's inter-communication capabilities provided by the 
APIs 170 and transport DLLs 152, the control objects CO in a system are capable of upper 
and lower edge control functions. Upper edge control functions include interaction with the 
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user interface 156, and lower edge control functions include interaction with the network 
media 36 and the devices 112-122. The control functions are related to the control object's 
logical representation of its associated physical device. In addition, by using extensions, a 
particular control object CO may logically and physically pass a control signal to a physical 
5 device directly, or send a message to the physical device's electronic controller or interface. 

Referring again to Figure 3, the control object CO also performs list management 162. 
List management is a feature of the invention whereby each control object CO maintains a list 
of its own state and the states of all other registered control objects existing in a live state on 
the network 10. An exemplary implementation of list management 162 is outline with respect 

10 to Figures 6 and 7. 

Referring to Figure 6, when a physical device 112-122 is first turned ON and 
functioning, its associated control object C01-C06 is enabled (S.100). The control object 
broadcasts a control message to inform other registered control objects that it exists (S.102). 
This will allow all other control objects within a given system to remain (or become) aware of 

15 each other's existence and world-state. If the control object CO is the first control object 
(S.104) to register with the system 10 (i.e., no other control objects are listed), the control 
object CO becomes a "manager object" (S.106). In addition to the control object's primary 
control duties with regard to the physical device it represents, the first control object CO (i.e., 
the manager object) maintains and administers a list of all other control objects. The list 

20 preferably contains an identifier (ID) and an IP address for each registered control object on 
the networked system 10. This feature makes the list of control objects self-administering. 
The identifiers are preferably globally unique random numbers generated at runtime, so as to 
identify each registered object "on-the-fly." This globally unique identifier may be also used 
with directed object-to-object communication, where a specific object must communicate with 

25 another specific object. Preferably, the random generator is a linear congruential generator; 
i.e., f(z) = 16807 z mod (2**31-1). 

The manager object responsibilities, however, are deliberately limited to allow each 
control object CO as much autonomy as it requires or is capable of having in view of the 
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device it is controlling. The manager object sends a copy of the world-state list to any new 
control object CO that registers with the system 10. Also, the manager object periodically 
broadcasts the list to registered control objects COs and performs a synchronization (i.e., takes 
a census) to force all other control objects to synchronize to the updated list (S.108). 
5 The manager object position is an elected position and all control objects COs have the 

ability to become the manager object should the manager object be disconnected or otherwise 
unable to perform its duties (S.l 10). The election of a manager object preferably is performed 
as illustrated in Figure 7 (S. 112). 

Referring now to Figure 7, when the manager object (e.g., COl) drops out of the 

10 system 10, the second registered control object (C02) becomes the manager object. All other 
control objects move up one position on the list (i.e., C03 becomes C02; C04 becomes C03; 
and COS becomes C04, etc.) and a new list is created. The newly created list is then 
replicated to all control objects on the system 10. However, if, for example control object 
C02 drops out of the system and control object COl remains, no election is held, but a new 

15 list is replicated and passed to all registered control objects. As further indicated in Figure 8, 
when a "heartbeat" (i.e., a periodic message from the manager object indicating that the 
manager object is alive) is not provided from the manager object within the specified arbitrary 
time limit, the first device to timeout waiting for the manager heartbeat message will 
automatically elect itself manager and immediately send an updated list to all other objects. 

20 In the example of Figure 8, if the timeout period expires for Object 2 prior to a heartbeat being 
received from the manager object. Accordingly, Object 2 elects itself as manager object and 
informs the other objects by sending a new list to all of the registered objects. This can mean, 
in cases where the manager is not actually inoperative, but rather just very busy, that manager 
object-related duties can pass to another registered object by way of default, rather than 

25 manager object failure. 

Referring back to Figure 6, after a new manager object is elected (S.l 12) and 
appointed as a manager object (S.l 14), the new manager object performs the duties discussed 
above with regard to S.108. It is noted that there are preferably cross checks to ensure that if 
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an manager object is rudely pulled out of service without a normal shut down message (e.g., 
its respective device ceases functioning without notice at S.110), that the system 10 will 
perform the recovery election of Figure 7. This will ensure the immediate determination and 
election of a manager object and that newly promoted manager object will take a new census 
5 of the remaining objects such that each control object will have an up-to-date list of other 
control objects. 

Referring back to S.104, when the control object CO registering with the system 10 is 
not the first object, it receives a list of registered objects from the manager object and will 
respond to queries from the manager object or other objects (S.116) while in an active state. 

10 Each control object CO preferably provides information only if queried by another object. All 
subordinate objects receive a "heartbeat" message from the manager object. If the heartbeat is 
not sent to the subordinate object in a pre-determined amount of time, the subordinate objects 
will automatically hold an election and one of these subordinates will become the manager (in 
the case where the manager object ceases to exist in a non-failsafe way). 

15 It is preferable that all control objects CO are peers in the system 10, and any 

physically dependent component that is less than a peer has a controller, which assumes the 
peer role. Further, when a physical device 112-122 is to be turned OFF and to cease 
functioning, it is preferable that the associated control object C01-C06 broadcast a message 
to inform other objects that it no longer exists and should be removed from the world-state 

20 list. 

Each control object preferably will be able to query any other CO to retrieve the other 
CO's state, dependencies, and possible actions. If no response is received, the CO will be 
considered to have gone to sleep, which will cause the manager CO to rebuild and present a 
new list to the remaining COs. 
25 User Interface 

The user interface 156 (consumer presentation display 130, 132 and 134) enables a 
user to control all devices 112-122 attached to the network via registered and controllable 
control objects. The consumer presentation display 130, 132 and 134 (CPD) supplies a 
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coherent and transparent interface across all network media and topologies. This 
communication and control may be across a logical network or may be local to a particular 
physical device. The CPD takes on the personality of a physical device, for which the 
attendant control object CO carries out logical and physical mapping and control 
5 responsibility. In the case of, e.g., the VCR 114, the CPD 130 contacts the VCR control 
object COS, queries the control object COS for capabilities and state information, and then 
presents a user with an appropriate display. The appropriate display in this example may 
include tape operation buttons and programming menus, which would be displayed by the 
CPD 130 on the laptop 49. That CPD would be capable of showing status for, and issuing 

10 commands to, the VCR 114 (through the registered control object COS). 

The CPDs 130, 132 and 134 are primarily expressed in this invention as a component 
of the upper-edge control mechanism. It is preferable that the operating system running on 
the laptop 49, pen computer (hand-held computer) 63, or desktop PC 20 contain a set of APIs 
to retrieve information from the control object CO and to generate the display of the CPD 130, 

15 132 and 134. In addition, the CPD preferably uses HTML formatting techniques and may be 
programmed in Visual BASIC, C/C++, or other programming language. Information from a 
particular control object CO may be retrieved by calling the appropriate API, and based on the 
information retrieved, the CPD formats an appropriate screen for the user to control the 
device. 

20 Although the general purpose computing devices are shown as CPDs 130, 132, 134, it 

is noted that any device having display capabilities may act as a CPD. In particular, because 
the CPD retrieves information from the control objects C01-C06, and the control objects 
C01-C06 all perform list management 162 and are aware of their world-state and the world- 
state of all other objects, a display provided with, e.g., the game device 112 may be used to 

25 operate the video device 114. This feature is provided by the APIs included in the game 
device operating system or the software application controlling the game device 112, which 
enables the game device's attendant control object C06 to control the video device 1 14 based 
on the world-state list information contained in the control object C06. The control object 
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C06 would communicate command and control information to the control object COS to 
accomplish physical control of the video device 114. Further, the display on the game device 
112 would be formatted to the personality of the VCR control display (i.e., display tape 
operation controls, etc.) in accordance with the world-state information. 
5 Figures 9A, 9B, 10A, 10B, 11 and 12 are exemplary Booch (class) diagrams that 

express the static structure of the object classes, their internal structure, and the relationships 
in which they participate in a preferred embodiment of the system described above with 
regard to Figures 2-7 in order to further provide one of skill in the art with a description of the 
present invention. It is noted that references in Figures 9 A, 9B, 10A, 10B, 11 and 12 to a 

10 "home object" are references to the "control object" above. 

It is noted that the foregoing examples have been provided merely for the purpose of 
explanation and are in no way to be construed as limiting of the present invention. While the 
invention has been described with reference to preferred embodiments, it is understood that 
the words which have been used herein are words of description and illustration, rather than 

1 5 words of limitations. Further, although the invention has been described herein with reference 
to particular means, materials and embodiments, the invention is not intended to be limited to 
the particulars disclosed herein; rather, the invention extends to all functionally equivalent 
structures, methods and uses, such as are within the scope of the appended claims. Those 
skilled in the art, having the benefit of the teachings of this specification, may effect numerous 

20 modifications thereto and changes may be made without departing from the scope and spirit 
of the invention in its aspects. 

For example, while the devices shown to be clients and controllable by the CO have 
been illustrated as a game device, a video device, a telephone, a smart AC outlet, an 
answering machine, and a television, other devices may be controlled include, but not limited 

25 to personal computers, security systems, dishwashers, etc. In addition, other operating 
systems than the Microsoft® Windows® family may be provided with the appropriate APIs to 
implement the features of the invention. 



